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(57)Abstract: 

PROBLEM TO BE SOLVED: To distinguish action of 
human being by using an omnidirectional image picked up 
from a camera. 

SOLUTION: This image processing system includes an S 
omnidirectional shooting device 10 and an image 
processing device 1 00. The omnidirectional shooting 
device 1 0 is provided with an omnidirectional image 
shooting means for shooting a image in an omnidirection, 
and a sending means for sending the omnidirectional 
image shot by the omnidirectional image shooting means 
to the image processing device 100. The image 
processing device 100 is provided with a human body 
action analyzing means for analyzing the action of the 
human body by using the omnidirectional image. 
Therefore, this image processing system can easily 
analyze the human body action by using the 
omnidirectional image. The omnidirectional image 
includes an image of a part of the human body. 



http://www19.ipdl.inpit.go.jp/PA1/result/detail/main/wAAAEba4tmDA414150273... 2009/12/07 


JP,2002-150273,A [CLAII. 


1/2 ^— V 


* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 


CLAIMS 


[Claim(s)] 

[Claim 1]An image processing system comprising containing an omnidirection photographing 
instrument and an image processing device: 

An omnidirection image photographing means in which said omnidirection photographing 
instrument photos a picture of an omnidirection. 

A human body action analysis means by which it has a means to transmit an omnidirection 
picture photoed by said omnidirection image photographing means to said image processing 
device, and said image processing device analyzes operation of a human body using said 
omnidirection picture. 

[Claim 2]An image processing system, wherein said omnidirection picture includes some pictures 
of said human body in the image processing system according to claim 1. 

[Claim 3]An image processing system, wherein said human body action analysis means is further 
provided with a means to record correspondence with an eyeball position when seeing the focus 
and this focus, and a means to compute a sight line direction of arbitrary eyeball positions 
according to said correspondence, in the image processing system according to claim 1. 
[Claim 4]An image processing device comprising: 

image processing device **** which carries out image processing of the omnidirection picture 
transmitted from an omnidirection photographing instrument — a means to receive said 
omnidirection picture. 

A human body action analysis means to analyze operation of a human body using said 
omnidirection picture. 

[Claim 5]An image processing device, wherein said omnidirection picture includes some pictures 
of said human body in the image processing device according to claim 4. 

[Claim 6]An image processing device, wherein said human body action analysis means is further 
provided with a means to record correspondence with an eyeball position when seeing the focus 
and this focus, and a means to compute a sight line direction of arbitrary eyeball positions 
according to said correspondence, in the image processing device according to claim 4. 
[Claim 7]An image processing method comprising: 

image processing method **** which carries out image processing of the omnidirection picture 
transmitted from an omnidirection photographing instrument — a step which receives said 
omnidirection picture. 

A human body action analysis step which analyzes operation of a human body using said 
omnidirection picture. 

[Claim 8]An image processing method, wherein said omnidirection picture includes some pictures 
of said human body in the image processing method according to claim 7. 
[Claim 9]An image processing method, wherein said human body action analysis step is further 
provided with a step which records correspondence with an eyeball position when seeing the 
focus and this focus, and a step which computes a sight line direction of arbitrary eyeball 
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positions according to said correspondence in the image processing method according to claim 7. 

[Claim 10]In a recording medium which recorded a program for making a computer perform an 
image processing method which carries out image processing of the omnidirection picture 
transmitted from an omnidirection photographing instrument and in which computer reading is 
possible, A recording medium which recorded a program for making a computer perform a step 
which receives said omnidirection picture, and a human body action analysis step which analyzes 
operation of a human body using said omnidirection picture and in which computer reading is 
possible. 

[Claim 1 1]A recording medium, wherein said omnidirection picture includes some pictures of said 
human body in the recording medium according to claim 10. 

[Claim 12]A recording medium, wherein said human body action analysis step is further provided 
with a step which records correspondence with an eyeball position when seeing the focus and 
this focus, and a step which computes a sight line direction of arbitrary eyeball positions 
according to said correspondence in the recording medium according to claim 10. 
[Claim 13]In a program for making a computer perform an image processing method which 
carries out image processing of the omnidirection picture transmitted from an omnidirection 
photographing instrument, A program for making a computer perform a step which receives said 
omnidirection picture, and a human body action analysis step which analyzes operation of a 
human body using said omnidirection picture. 

[Claim 14]A program, wherein said omnidirection picture includes some pictures of said human 
body in the program according to claim 13. 

[Claim 15]A program, wherein said human body action analysis step is further provided with a 
step which records correspondence with an eyeball position when seeing the focus and this 
focus, and a step which computes a sight line direction of arbitrary eyeball positions according to 
said correspondence in the program according to claim 13. 


[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 


DETAILED DESCRIPTION 


[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]Especially this invention relates to the image processing system, the 
image processing device, the image processing method, recording medium, and program which 
conduct human body action analysis using an omnidirection picture about an image processing 
system, an image processing device, an image processing method, a recording medium, and a 
program. 
[0002] 

[Description of the Prior Art]Conventionally, in order to identify human being's action using a 
camera image, the system which used a WERA bull computer, a configuration camera, a sight line 
detection sensor, etc. exists, for example. 
[0003] 

[Problem(s) to be Solved by the Invention] However, in the system which equips glasses and a 
hat with the system using a WERA bull computer, i.e., the usual CCD camera, and acquires the 
picture of human being's front direction. In order to install so that human being's body or its part 
generally may not be reflected in a camera image, there is a problem that analysis of human 
being of operation is difficult. 

[0004]With the system using an environmental installation camera, i.e., the system which 
analyzes operation of human being using the camera installed in the position which separated 
with human being. The processing which starts segments, such as human being's head, an arm, 
and a leg, out of an image frame is needed, and since the position in which a human body exists 
in a picture is indefinite and wide range, there is a problem that the logging processing becomes 
difficult. 

[0005]When human being's action is caught widely, detection of eye movement, i.e., line of sight 
detection, is a kind of detection of human being of operation, but. In the system which measures 
eye movement by sensors, such as a camera, in order to detect the system using the 
conventional sight line detection sensor, i.e., a sight line direction. Since the sensor which 
acquires the picture of the direction which the sensor which detects a sight line direction, and 
human being are looking at is a separate device, there is a problem that a strict calibration is 
needed among both. 

[0006]While the purpose of this invention equips a human body with an omnidirection sensor in 
view of the above-mentioned problem and acquiring the picture of human being's person, It is in 
providing the image processing system, the image processing device, image processing method, 
and recording medium which can identify operation of a human body efficiently by putting some 
human bodies in an image frame, and photoing it. 
[0007] 

[Means for Solving the Problem]In an included image processing system, the invention according 
to claim 1 an omnidirection photographing instrument and an image processing device said 
omnidirection photographing instrument, It had an omnidirection image photographing means 
which photos a picture of an omnidirection, and a means to transmit an omnidirection picture 
photoed by said omnidirection image photographing means to said image processing device, and 
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said image processing device was provided with a human body action analysis means to analyze 
operation of a human body using said omnidirection picture. 

[0008]Thereby, since an omnidirection picture is used for an image processing system of this 
invention, it becomes possible to analyze a human body action easily. 

[0009]ln the invention according to claim 2, in the image processing system according to claim 1, 
said omnidirection picture includes some pictures of said human body. 

[0010]Thereby, since some human bodies are put in an image frame and it is photoed, operation 
of a human body is efficiently discriminable. That is, the image processing system of this 
invention can make detection of operation of a human body easier by using a human body model 
having included a size of a human body, a movable direction of a joint, a movable range, etc. in 
the case of detection of a hand of operation, for example. If a constraint that a shoulder, an arm, 
and a hand are continuing as a model of a human body is taken into consideration, and it 
searches for a range which continues as a picture from a left shoulder, detection of the right- 
hand point will become easy. Although a movable range of a hand to a position of a shoulder is 
naturally also restricted in a human body, since a hand's existence range is limited also in a 
picture, this is wide range, it becomes unnecessary to search [ be / it / under / all the picture / 
receiving] for a position of a hand, and it becomes easy of operation to detect it. Since a picture 
of a direction which eye movement and human being for line of sight detection are actually 
looking at can picturize by one sensor further again, for example, simplification of a calibration 
can be attained. 

[001 1]As for the invention according to claim 3, in the image processing system according to 
claim 1, said human body action analysis means was further provided with a means to record 
correspondence with an eyeball position when seeing the focus and this focus, and a means to 
compute a sight line direction of arbitrary eyeball positions according to said correspondence. 
[0012]Thereby, it enables an image processing system of this invention to compute a sight line 
direction easily. 

[0013]written this invention is characterized by it having been alike and comprising the following 
at claim 4. 

image processing device **** which carries out image processing of the omnidirection picture 
transmitted from an omnidirection photographing instrument — a means to receive said 
omnidirection picture. 

A human body action analysis means to analyze operation of a human body using said 
omnidirection picture. 

[0014]Thereby, since an omnidirection picture is used for an image processing device of this 
invention, it becomes possible to analyze a human body action easily. 

[0015]In the invention according to claim 5, in the image processing device according to claim 4, 
said omnidirection picture includes some pictures of said human body. 

[0016]Thereby, since some human bodies are put in an image frame and it is photoed, operation 
of a human body is efficiently discriminable. That is, the image processing device of this 
invention can make detection of operation of a human body easier by using a human body model 
having included a size of a human body, a movable direction of a joint, a movable range, etc. in 
the case of detection of a hand of operation, for example. If a constraint that a shoulder, an arm, 
and a hand are continuing as a model of a human body is taken into consideration, and it 
searches for a range which continues as a picture from a left shoulder, detection of the right- 
hand point will become easy. Although a movable range of a hand to a position of a shoulder is 
naturally also restricted in a human body, since a hand's existence range is limited also in a 
picture, this is wide range, it becomes unnecessary to search [ be / it / under / all the picture / 
receiving ] for a position of a hand, and it becomes easy of operation to detect it. Since a picture 
of a direction which eye movement and human being for line of sight detection are actually 
looking at can picturize by one sensor further again, for example, simplification of a calibration 
can be attained. 

[0017]As for the invention according to claim 6, in the image processing device according to 
claim 4, said human body action analysis means was further provided with a means to record 
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correspondence with an eyeball position when seeing the focus and this focus, and a means to 
compute a sight line direction of arbitrary eyeball positions according to said correspondence. 
[001 8]Thereby, it enables an image processing device of this invention to compute a sight line 
direction easily. 

[0019]written this invention is characterized by it having been alike and comprising the following 
at claim 7. 

image processing method **** which carries out image processing of the omnidirection picture 
transmitted from an omnidirection photographing instrument — a step which receives said 
omnidirection picture. 

A human body action analysis step which analyzes operation of a human body using said 
omnidirection picture. 

[0020]Thereby, since an omnidirection picture is used for an image processing method of this 
invention, it becomes possible to analyze a human body action easily. 

[0021]ln the invention according to claim 8, in the image processing method according to claim 7, 
said omnidirection picture includes some pictures of said human body. 

[0022]Thereby, since some human bodies are put in an image frame and it is photoed, operation 
of a human body is efficiently discriminable. That is, the image processing method of this 
invention can make detection of operation of a human body easier by using a human body model 
having included a size of a human body, a movable direction of a joint, a movable range, etc. in 
the case of detection of a hand of operation, for example. If a constraint that a shoulder, an arm, 
and a hand are continuing as a model of a human body is taken into consideration, and it 
searches for a range which continues as a picture from a left shoulder, detection of the right- 
hand point will become easy. Although a movable range of a hand to a position of a shoulder is 
naturally also restricted in a human body, since a hand's existence range is limited also in a 
picture, this is wide range, it becomes unnecessary to search [ be / it / under / all the picture / 
receiving ] for a position of a hand, and it becomes easy of operation to detect it. Since a picture 
of a direction which eye movement and human being for line of sight detection are actually 
looking at can picturize by one sensor further again, for example, simplification of a calibration 
can be attained. 

[0023]ln the image processing method according to claim 7, the invention according to claim 9 
said human body action analysis step, It has further a step which records correspondence with 
an eyeball position when seeing the focus and this focus, and a step which computes a sight line 
direction of arbitrary eyeball positions according to said correspondence. 
[0024]Thereby, it enables an image processing method of this invention to compute a sight line 
direction easily. 

[0025]In a recording medium which recorded a program for the invention according to claim 1 0 to 
make a computer perform an image processing method which carries out image processing of the 
omnidirection picture transmitted from an omnidirection photographing instrument and in which 
computer reading is possible, It is characterized by being the recording medium which recorded a 
program for making a computer perform a step which receives said omnidirection picture, and a 
human body action analysis step which analyzes operation of a human body using said 
omnidirection picture and in which computer reading is possible. 

[0026]Thereby, since an omnidirection picture is used according to the recording medium of this 
invention, it becomes possible to analyze a human body action easily. 

[0027]In the invention according to claim 1 1 , in the recording medium according to claim 1 0, said 
omnidirection picture includes some pictures of said human body. 

[0028]Thereby, since some human bodies are put in an image frame and it is photoed, operation 
of a human body is efficiently discriminable. That is, according to the recording medium of this 
invention, detection of operation of a human body can be made easier by using a human body 
model having included a size of a human body, a movable direction of a joint, a movable range, 
etc. in the case of detection of a hand of operation, for example. If a constraint that a shoulder, 
an arm, and a hand are continuing as a model of a human body is taken into consideration, and it 
searches for a range which continues as a picture from a left shoulder, detection of the right- 
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hand point will become easy. Although a movable range of a hand to a position of a shoulder is 
naturally also restricted in a human body, since a hand's existence range is limited also in a 
picture, this is wide range, it becomes unnecessary to search [ be / it / under / all the picture / 
receiving ] for a position of a hand, and it becomes easy of operation to detect it. Since a picture 
of a direction which eye movement and human being for iine of sight detection are actually 
looking at can picturize by one sensor further again, for example, simplification of a calibration 
can be attained. 

[0029]In the recording medium according to claim 10, the invention according to claim 12 said 
human body action analysis step, It has further a step which records correspondence with an 
eyeball position when seeing the focus and this focus, and a step which computes a sight line 
direction of arbitrary eyeball positions according to said correspondence. 
[0030]Thereby, according to the recording medium of this invention, it becomes possible to 
compute a sight line direction easily. 

[0031]ln a program for the invention according to claim 13 to make a computer perform an image 
processing method which carries out image processing of the omnidirection picture transmitted 
from an omnidirection photographing instrument, It is characterized by being a program for 
making a computer perform a step which receives said omnidirection picture, and a human body 
action analysis step which analyzes operation of a human body using said omnidirection picture. 
[0032]Thereby, since an omnidirection picture is used according to the program of this invention, 
it becomes possible to analyze a human body action easily. 

[0033]In the invention according to claim 14, in the program according to claim 13, said 
omnidirection picture includes some pictures of said human body. 

[0034]Thereby, since some human bodies are put in an image frame and it is photoed, operation 
of a human body is efficiently discriminable. That is, according to the program of this invention, 
detection of operation of a human body can be made easier by using a human body model having 
included a size of a human body, a movable direction of a joint, a movable range, etc. in the case 
of detection of a hand of operation, for example. If a constraint that a shoulder, an arm, and a 
hand are continuing as a model of a human body is taken into consideration, and it searches for 
a range which continues as a picture from a left shoulder, detection of the right-hand point will 
become easy. Although a movable range of a hand to a position of a shoulder is naturally also 
restricted in a human body, since a hand's existence range is limited also in a picture, this is 
wide range, it becomes unnecessary to search [ be / it / under / all the picture / receiving ] for 
a position of a hand, and it becomes easy of operation to detect it. Since a picture of a direction 
which eye movement and human being for line of sight detection are actually looking at can 
picturize by one sensor further again, for example, simplification of a calibration can be attained. 
[0035]In the program according to claim 13, the invention according to claim 15 said human body 
action analysis step, It has further a step which records correspondence with an eyeball position 
when seeing the focus and this focus, and a step which computes a sight line direction of 
arbitrary eyeball positions according to said correspondence. 

[0036]Thereby, according to the program of this invention, it becomes possible to compute a 

sight line direction easily. 

[0037] 

[Embodiment of the Invention]Hereafter, the embodiment of this invention is described in detail, 
referring to drawings. 

[0038](A 1st embodiment) Drawin g 1 is a figure showing an example of the composition of the 
human body action analysis system concerning a 1st embodiment of this invention, and shows 
only the portion related to this invention notionally among the composition of this system. 
[0039]The omnidirection image photographing apparatus 10 with which a between [ the lenses of 
glasses ] or both-ends, and shoulder top or the parietal region was equipped with the human 
body action analysis system, The image processing device 100 which processes the picture 
information transmitted from the omnidirection image photographing apparatus 1 0 via a wireless 
means (for example, partial radio, wireless LAN, etc., such as Bluetooth, are included), and 
analyzes a human body action is included. 

[0040] Drawing 2 is a figure showing an example of the composition of the omnidirection image 
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photographing apparatus 1 0 of this invention, and shows only the portion related to this invention 
notionally among the composition of this device. 

[0041 ]The control section 30 which performs control of at least various kinds [ image 
photographing apparatus / 10 / omnidirection 3, It comprises the transmission and reception 
section 32 which transmits and receives a signal between image processing device 1 00 grades, 
the storage parts store 34 which begins the picture photoed by the omnidirection picture 
photographing part 20, and memorizes various data, and the input part 36 for being constituted 
by the button etc. and inputting a user's intention. 

[0042]In this embodiment, the program for image transformation is stored in the storage parts 
store 34, and the control section 30 has changed into the usual picture the picture photoed by 
the omnidirection picture photographing part 20 according to this program (for example, originally 
a linear thing is made visible to a straight line). The changed picture may be displayed on an 
indicator (not shown). The image transformation can transmit the picture photoed by the 
omnidirection picture photographing part 20 to other terminals (image processing device 100 
grade), can also perform it at this terminal, and can also omit for example, the storage parts 
store 34 grade of the omnidirection image photographing apparatus 10 in that case. 
[0043]In this embodiment, the user of the omnidirection image photographing apparatus 10 can 
take out a part of picture (the picture after conversion is included) photoed by the omnidirection 
picture photographing part 20. Extraction can be performed by specifying a field by the input part 
36, for example, looking at a picture by an indicator (not shown). A jog dial is provided in the 
input part 36, and the display portion of a picture is changed and it can make it possible to more 
specifically choose a portion to take out, for example. And the taken-out picture can be sent to 
other terminals. The picture photoed by the omnidirection picture photographing part 20 is 
transmitted to other terminals (for example, image processing device 100), and the part can be 
taken out at this terminal (if required). It may transmit, after the omnidirection image 
photographing apparatus 10 performs image transformation, and the terminal of these others may 
perform image transformation before after-transmission extraction. 
[0044] Drawing 3 is a figure showing an example of the omnidirection image photographing 
apparatus 10. The omnidirection image photographing apparatus itself shown in drawing 3 is 
publicly known, and it has the camera 24 arranged along the same axis at the omnidirection 
sensor 22, for example, a convex mirror, and the crowning of this convex mirror 22, and the 
position that counters. The transparent outer case 26 is equipped with the convex mirror 22 and 
the camera 24. He is trying to condense the light from the omnidirection of 360 degrees 
centering on a camera optical axis to a camera lens in the convex mirror 22 in the omnidirection 
image photographing apparatus shown in drawin g 3. Thereby, the omnidirection of the visual field 
range of 360 degrees centering on a camera optical axis can be photoed. In order to prevent 
reflection by the inner surface of the outer case 26, coat the inner surface with an antireflection 
film, or. Or the rod-like structure of cone shape which is indicated by JP,1 1-174603.A, for 
example is provided in the crowning of the convex mirror 22, and the tip side of the rod-like 
structure may turn a convex mirror 22 axis extension-top to the camera 24, and may make it 
extend. 

[0045] Drawing 4 is a figure showing another example of the omnidirection image photographing 
apparatus 10. As shown in drawin g 4, as an omnidirection image device, a thing still smaller than 
what is shown in drawing 3 can also be used. 

[0046]As an omnidirection image photographing apparatus, it is not restricted to what was shown 
in drawin g 3 or drawing 4 , but as long as it can photo the picture of an omnidirection, what kind 
of thing may be used. For example, there are various things, such as a thing of a type which 
rotates a flat mirror in addition to a thing with the hyperboloid used by the camera which carries 
a fish-eye lens as a sensor which can acquire the picture of an omnidirection, drawing 3 , or 
drawin g 4, or the mirror plane of the secondary function. There are also what carries many 
cameras, and a thing which rotates a camera. Many things are known as an omnidirection image 
photographing apparatus, and as an example, JP.1 1-174603.A, JP.6-14121 1,A, "JP,4-105476,A, 
acquisition of the position information by the omnidirection visual sensor using a circular-cone 
mirror (Vol.J74 _ D-H, No.1, Institute of Electronics, Information and Communication Engineers 
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paper magazine D-II, pp. January, 26-1991 [ 19-] besides Yagi), What was indicated to "the 
omnidirection visual sensor for a mobile robot's navigation" (Vol.J79-D-]I, No.5, Institute of 
Electronics, Information and Communication Engineers paper magazine D-II, pp. May, 707-1 996 
[ 698-] besides Yamazawa), etc. is mentioned. 

[0047] Drawing 5 is a figure showing an example of the composition of the image processing 
device 100 with which this invention is applied, and shows only the portion related to this 
invention notionally among these composition. 
[0048]The image processing device 100 of this invention comprises: 

The programmed main control part (it is called a control means and following CPU for short) 102 
which controls the whole system in generalization at least. 

. Are connected to CPU 102 via the bus 104. the output units 110, such as the input device 106 
which comprises various pointing devices and keyboards, such as a mouse, an image scanner, a 
digitizer, etc., the display 108 used for the monitor of input data, and a printer which outputs a 
various audit result and other data, and a communication line (a cable/radio.). The 
communication port 112 which comprises the modem and terminal adopter which are connected 
including LAN/Internet, and an analog to digital etc., DSU, etc. 

The input device 106, the display 108, and the output unit 110 may be connected to CPU 102 via 
an I/O interface, respectively. 

[0049]CPU102 has an internal memory for storing the program which specified control programs, 
such as OS (Operating System), various kinds of procedure, etc., and required data, and by these 
programs. Information processing for performing various image processing and human body 
action analysis processings is performed. The memory storage 120 Hard disk units, such as 
storage devices, such as RAM and ROM, and a hard disk, It is a storage means of a flexible disk, 
an optical disc, etc., and various kinds of tables and files, a database, etc. which are used for 
various processing are stored, and the sight fine direction enumeration function 122 mentioned 
later is stored at least. The input device 106 is an input means as which a user inputs various 
data, and contains the mouse for selecting the menu on a screen and inputting data, a keyboard, 
an image scanner, etc. The display 108 has various menu screens and a function which displays 
a processing result etc., for example, is a display device etc. The output unit 1 10 has a function 
which outputs a processing result to media, such as paper, for example, is a printer etc. The 
communication port 112 has a function which communicates data via the omnidirection image 
photographing apparatus 10, other terminals, and communication. The image processing device 
100 connects peripheral equipment, such as a printer, a display, and an image scanner, to 
information processors, such as a known personal computer, a workstation, or PDA, It may 
realize by mounting software (a program, data, etc. are included) which realizes the human body 
action analyzing method of this invention in this information processor. 
[0050]Next, an example of operation of the human body action analysis system in this 
embodiment constituted in this way is explained in detail with reference to drawing 6 t hru/or 
drawing 8 below. 

[0051]The human body action analysis system of this invention makes detection of operation of 
a human body easier by using a human body model having included the size of a human body, the 
movable direction of a joint, the movable range, etc. in the case of detection of a hand of 
operation, for example. That is, if the constraint that the shoulder, the arm, and the hand are 
continuing as a model of a human body is taken into consideration, and it searches for the range 
which continues as a picture from a left shoulder, detection of the right-hand point will become 
easy. Although the movable range of the hand to the position of a shoulder is naturally also 
restricted in a human body, since a hand's existence range is limited also in a picture, this is 
wide range, it becomes unnecessary to search [ be / it / under / all the picture / receiving ] for 
the position of a hand, and it becomes easy of operation to detect it. 
[00523 Drawing 6 is a figure showing an example of the omnidirection picture at the time of 
equipping an omnidirection visual sensor on a left shoulder, and detecting especially a motion of 
a left hand. 

[0053]Since according to the example shown in drawing 6 a left hand always exists in the center 
section of a figure, a front object exists in the right portion and the back object exists in the left 
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portion, detection of left operation becomes easy. Thus, since the range which the hand to the 
shoulder position of the human body in a picture can exist is limited, it becomes possible, for 
example by analyzing the texture of the portion of an arm to presume the existence range of the 
hand in a picture. 

[0054]By using a picture which the picture shown in drawing 6 is only an example, and displays 
the portion of a human body on a homotype enclosure fixed also in other pictures, The existence 
range can be restrained by becoming possible to presume the existence range of the portion 
concerned in a picture, and pinpointing the existence position of a shoulder also about the 
information on the transverse plane of the human body in an omnidirection picture, or the back, 
for example. The same thing is applied also when an omnidirection visual sensor is carried in the 
position of the parietal region or others. 

[0055] Drawing 7 is a figure showing an example of the omnidirection picture at the time of 
equipping an omnidirection visual sensor between the lenses of glasses, and detecting especially 
a motion of an eyeball. 

[0056]According to the example shown in drawing 7 , it is possible to photo the object which 
people's face always exists in the center portion of a figure, and exists in the right-and-left 
portion of a figure by adjusting the direction of an omnidirection visual sensor at a front object It 
becomes possible easily to detect the object which is in a sight line direction and a sight line 
direction by detecting the eyeball position of a face in this picture. That is, since the front object 
exists in the right-and-left portion of a figure, detection of a sight line direction becomes easy 
by detecting the position of the iris of the eye of an eyeball. 

[0057] Drawing 8 is a figure showing an example of the omnidirection picture at the time of 
equipping the left end of the lens of glasses with an omnidirection visual sensor, and detecting 
especially a motion of the eyeball of a left eye. 

[0058]Since according to the example shown in drawin g 8 the eyeball of a left eye always exists 
in the right portion of a figure and the object of a head front direction, i.e., a sight line direction, 
exists in the left portion of a figure, it becomes possible to photo simultaneously the object of 
the sight line direction by operation and eye movement of an eyeball. 

[0059]As mentioned above, some human bodies (for example, a shoulder, a hand, an eyeball, a 
nose, etc.) reflected into the picture serve as a constraint, and simplification of image processing 
can be attained on the occasion of human being's operation analysis. 

[0060]Since the picture of the direction which the eye movement and human being for line of 
sight detection are actually looking at can picturize by one sensor, simplification of a calibration 
can be attained. 

[0061]It also becomes possible to correct the error at the time of wearing, using positions 
always photoed, such as eyes, a nose, and a shoulder, as the focus. 

[0062] Drawing 9 is a flow chart showing an example of the line of sight detection processing in 
the human operation-analysis system by which a 1st embodiment of this invention is applied, and 
shows only the portion related to this invention notionally among these processings. Here, each 
step explained in drawing 9 is realized by the program etc. which are executed in 1 02 in the 
hardware-constitutions figure of the image processing device 1 00 explained by drawin g 5. 
[0063]Here, as the method of line of sight detection, LED which is in a known position to an 
omnidirection sensor may be shown, it may repeat seeing the direction, and the function which 
computes a sight line direction by taking correspondence of the LED position (focus) in a picture 
and a dark-eyed position may be determined, for example. Change of not a strict method, such 
as LED in a known position, but the feature marker (focus) shown on the screen of PC and the 
background currently picturized may be compared. It may perform "repeating showing LED and 
seeing the direction" altogether to each pixel, and the data may be table-ized beforehand. 
[0064]lt is considered as the method of performing a calibration to below strictly, 1 . The glasses 
of omnidirection sensor loading. 2. user whom a position (direction) shows known LED in a user's 
applied field of view explains to an example how to determine the function which matches the 
centroid position of 4. iris of the eye which computes the centroid position of the iris of the eye 
in 3. picture which looks at the direction of LED, and the position (direction) of known LED. 
[0065]Before performing a calibration, correspondence of the direction currently regarded as the 
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dark-eyed position cannot be taken, but for both persons, after a calibration is matched. 
[0066]First, wearing of a sensor is detected and an omnidirection picture is received from the 
image processing device 1 00 (Step S902). 

[0067]Subsequently, the sight line direction enumeration function 1 22 stored in 1 20 is initialized 
(Step S904). "The sight line direction enumeration function 1 22" means the function for 
computing a sight line direction by complementing the position during two or more "focus" which 
is the characteristic image regions in a look. 
[0068]Subsequently, the counter i is initialized by 0 (Step S906). 

[0069]Subsequently, the presentation N [ several ] of the focus for a calibration is compared 
with i (Step S910). 

[0070]From i, N presents the focus, in being large, and the wearing person of a sensor looks at 
the direction (Step S916). 

[0071]Subsequently, the picture for a calibration is acquired (Step S918), and the function which 
determines a sight line direction based on this picture is computed. 

[0072]Subsequently, matching of the eyeball (iris of the eye) position on the acquired picture and 
the focus presentation direction is performed (Step S920). For example, in the case of the 
sensor of glasses loading, since [ which it is on a picture ] grade limitation is carried out, the 
range in which an eyeball exists can attain simplification of matching. 
[0073]Subsequently, i is **************ed (Step S924) and it returns to Step S910. 
[0074]If processing to Step S91 6 thru/or Step S924 is performed about all the focus, the sight 
line direction calculation phase which usually performs line of sight detection during work based 
on the function acquired by the calibration will be performed. 

[0075] First, according to the result of matching of Step S920, a sight line direction enumeration 
function is updated about all the focus (Step S911). 

[0076]Subsequently, for example, a sight line direction is detected based on a sight line direction 
enumeration function, acquiring a picture continuously with a part for second 30Frame, and a 
camera (Step S914). (Step S912) As long as it carries out line of sight detection off-line, line of 
sight detection of the acquired picture may be analyzed and carried out later. 
[0077](A 2nd embodiment) A human operation-analysis system like a 1st embodiment A wireless 
communication means. In the image processing device 100, carry out image processing of the 
picture information which passes (for example, partial radio, wireless LAN, etc., such as 
Bluetooth, are included), and is transmitted from the omnidirection image photographing 
apparatus 10, and analyze a human body action, and also. Picture information can also be 
transmitted by a wire communication means like this embodiment (a 2nd embodiment). 
[0078] Drawing 10 is a figure showing an example of the appearance of the human operation- 
analysis system concerning a 2nd embodiment of this invention. Here, since the portion which 
attached the same numerals as drawing 1 has the same function, it omits explanation. 
[0079]Equipping the usual camera with an omnidirection sensor (for example, thing shown in 
drawing 3 or drawing 4) can also photo the picture of an omnidirection. And an image can be 
captured into a personal digital assistant if a camera is connected to a personal digital assistant 
[0080](Other embodiments) In the embodiment mentioned above, although the case where each 
embodiment was realized independently was explained to an example, this invention is not limited 
in this case and that of the ability to carry out combining each embodiment suitably is obvious 
for a person skilled in the art in other embodiments. 

[0081]AIthough the case where the omnidirection image photographing apparatus 10 and the 
image processing device 100 were realized as an independent case was explained to an example 
in the embodiment mentioned above, This invention is not limited in this case and it is obvious in 
other embodiments that it can carry out as one case mutually, combining these suitably for a 
person skilled in the art. 

[0082]Various modification is possible besides the gestalt described above. However, as long as 
the modification is due to the technical thought indicated to the claim, the modification becomes 
technical within the limits of this invention. 

[0083]The processing performed by the programmed main CPU 102 grade which was mentioned 
above in other embodiments of this invention further again, a recording medium (for example, a 
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floppy (registered trademark) disk and CD-ROM.) It is possible by making it record on 
transmission media (for example, a digital data stream, a subcarrier, etc.), such as DVD-ROM and 
a hard disk, with the gestalt of a program, and loading to the memory of arbitrary computers, etc. 
to make it perform for each device of every always, when required. That is, in other embodiments 
of this invention, this invention can be carried out as a computer program product which is 
loaded to CPU and performed in computer systems. The program of it being installable in a 
computer in many forms (gestalt) which defines each means of this invention is obvious to a 
person skilled in the art. A non-writing in storage usable with the (a) computer as an example of 
such forms, for example, ROM which can be read with the input/output device of a computer. 
The form of the information currently eternally held in a CD-ROM disc, a DVD-ROM disk, etc., 
(b) The storage in which writing usable with a computer is possible. (For example, RAM, a floppy 
(registered trademark) disk, hard disk drive, etc.) To inside. Like the computer-data signal etc. 
which were put on the form, (c), for example, the digital data stream, or the subcarrier of the 
information currently held beforehand, There are form etc. of the information transmitted to a 
computer via a telephone line and a transmission medium like a network using communication 
control units, such as a modem, and this invention is not limited to such forms.Therefore, as for 
the medium which manages the human body action analyzing method of this invention and which 
recorded the program which can be read by computer, it is obvious for a person skilled in the art 
to give other embodiments of this invention. 
[0084] 

[Effect of the Invention]As explained to details above, since an omnidirection picture is used 
according to this invention, it becomes possible to analyze a human body action easily. 
[0085]Since according to this invention some human bodies are put in an image frame and it is 
photoed, operation of a human body is efficiently discriminable. That is, the image processing 
system of this invention can make detection of operation of a human body easier by using a 
human body model having included the size of a human body, the movable direction of a joint, the 
movable range, etc. in the case of detection of a hand of operation, for example. If the constraint 
that the shoulder, the arm, and the hand are continuing as a model of a human body is taken into 
consideration, and it searches for the range which continues as a picture from a left shoulder, 
detection of the right-hand point will become easy. Although the movable range of the hand to 
the position of a shoulder is naturally also restricted in a human body, since a hand's existence 
range is limited also in a picture, this is wide range, it becomes unnecessary to search [ be / it / 
under / all the picture / receiving ] for the position of a hand, and it becomes easy of operation 
to detect it. Since the picture of the direction which the eye movement and human being for line 
of sight detection are actually looking at can picturize by one sensor further again, for example, 
simplification of a calibration can be attained. 

[0086]According to this invention, it becomes possible to compute a sight line direction easily. 


[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 


DESCRIPTION OF DRAWINGS 


[Brief Description of the Drawings] 

[Drawin g 1]It is a figure showing an example of the composition of the human body action 
analysis system concerning a 1 st embodiment of this invention. 

[Drawing 2] It is a figure showing an example of the composition of the omnidirection image 
photographing apparatus 10 of this invention. 

[Drawin g 3]It is a figure showing an example of the omnidirection image photographing apparatus 
10. 

[Drawin g 4]It is a figure showing another example of the omnidirection image photographing 
apparatus 10. 

[Drawin g 5]It is a figure showing an example of the composition of the image processing device 
100 with which this invention is applied. 

[Drawin g 6]It is a figure showing an example of the omnidirection picture at the time of equipping 
an omnidirection visual sensor on a left shoulder, and detecting especially a motion of the left 
arm. 

[ Drawin g 7]It is a figure showing an example of the omnidirection picture at the time of equipping 
an omnidirection visual sensor between the lenses of glasses, and detecting especially a motion 
of an eyeball. 

[Drawin g 8]It is a figure showing an example of the omnidirection picture at the time of equipping 
the left end of the lens of glasses with an omnidirection visual sensor, and detecting especially a 
motion of the eyeball of a left eye. 

[ Drawin g 9]lt is a flow chart showing an example of the line of sight detection processing in the 
human operation-analysis system by which a 1st embodiment of this invention is applied. 
[Drawing 10] It is a figure showing an example of the appearance of the human operation-analysis 
system concerning a 2nd embodiment of this invention. 
[Description of Notations] 

10 Omnidirection image photographing apparatus 
20 Omnidirection picture photographing part 
22 Convex mirror 
24 Camera 
26 Outer case 
30 Control section 

32 Transmission and reception section 
34 Storage parts store 
36 Input part 

100 Image processing device 
102 CPU 
104 Bus 

1 06 Input device 

108 Display 

110 Output unit 

1 1 2 Communication port 
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1 20 Memory storage 

1 22 Sight line direction enumeration function 


[Translation done.] 
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e*©iE8J<H*fc4s^T\ fE^SfiffllB, tufBAft 

[0 0 2 8] Ctlti!), Aft©-gPt>B#7U-A© 

tftAnT«K-r«©-e, A#©»ft&»*«K:W8i.i , r 

*cfc#T?**. *«W©iB»jii*fcJ:n 
tf, ¥©ftffl*ffl©IBtt» A<*©**2*MW 

©nl»#6k ^IWEHSfc^A^AfctTrt/fc/a^Sc 

ttcfcf), A*©»t^©*m*«tt)SSfc-r*ct*'T' 

S„ S6fc» «©4Milc*«-*#©RllWiHfeA#T?tt 

#*E«HjWB6«ti*ft»x £®«s*{cttLT¥©ffiB 
*j£«H-ffflafr S«8W*<ft < ft !)«f«HJWWii:a 
S„ S5fc£ft, 0iJ*.tf» £tftfttfi©fcJ&©HPBI»i: 
AH#£IRfcJlT^S#fa©iIH*tf 1 OO-b V*J-T?JWfc 

50 7?#So 

[0 0 2 9] M&R 1 2MBR©aiPl& WaCT 1 Ofc 
13K©I2»«{*£ *^T, futBAftfjff^tfrXx v f 

^{u§©^^[p]^Wffi-r « X-f >y 6 fc s 

cfc%#^i:-rSo 

[0 0 3 0] dhfci!), *«K©ES«{*:fc:J:ntfs 
[0 0 3 1] tt*^ 1 3KE*©5SWtt. 

w m^?,^fl$ns^ffiinf^B«Mat-s®{fMa^ 

ffi%n»fa-^t^f«-1±Src:i6©ya^A{cfe^ 
Ts MfB£MEB#£Sft-rsX7^7fc, tuffi^fu 
■MMffliC A(*©«ft*j**ff f « AfrK^fSWXx y 
7i:?:3ytfa.-^tc»f^-&S/c46©7 P D^AT$. 
Sci:^#i!!i:-rSo 

[0 0 3 2] ctifciO, *S5W©7n^7AK:±n 
ti\ ^W*ffl^§OT\ SStA#ftf^©l!l«f* 

[0033] mxm 1 4 tctB«©%wti, mm. \ 3tc 

50 |E«©7'n^9Afe:*V^T, «raa^ffiH«», MIBA 
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(5) 


mm 2002-150273 
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[0 0 3 4] cniC&Kl, AW<D-ffi$>m»7]s-L.(D fxifv L.lC'&r>T, £73&B«fI£g|5 2 01?jf»Lfc 

irfci t), A#©»ff©ttai*J: DSSfTie: i:*«Tf (B#©aSH 1 0 0W) fc^iLTl&«*Tl75 c t 

#5„ AttO^rrt/fcLTJi, flfik ¥ite!«*RL fcT?£, £73{fflf$!»f£SB 1 0©?"5© 

TjBRt-5«H*aiiS-rtltf^#5feO*a« t ?PSK:& [0 0 4 3] $fc» *ISSf0£t8fc*^Ttt, ^MIII 

S„ S 5 fc, HOia«fc»t-*¥ORl«ttH fc AfrTtt »f£3gg 1 0 ©a— if tt, £#ttHft3Hgffi 2 0 Tf SHg 

§0 $?»(cSfc, fl|*.tf, liMlilOfttOlXlli: fT?<:fc#T^5o iOJtttttfctt* 09*tfs A^3 

AIBjWMEfcJlTV^**rtOWW 1 ■owsvumto 6 tc->*3 994 WOm. H«0«a5»»*SHL 

T*3o #5. S&DfflLfcB#fcffi©«*£&3Ci:tf 

[0 0 3 5] M#H1 5tia«0«Wtt, M*SU 3t T'f5„ ^ffilHWi»»2 0 TfJi»LftB«* 

IE*©7n^Afc*5^T % M12A#:Si{t(SfrXx-y/ 20 ffi©«* (^J^tt'B^ag^ 1 0 0) tcSS«LTR«S 

[0 0 3 6] cntit), *«Worny7AK*n [0 0 4 4] H3B. ^ffiMHieBI 1 0 ©-fljfc 

[0 0 3 7] »n?fc!K «?iJx.tt'ia®«2 2*itfCO 

WO*MBHIBfcOW'»TlHBfc|i«r*. 2 4 £#f3o il®«2 2 tilt? 2 4 

[0038] (g 1 mmm m 1 xmxom 1 * jo t*2W4^«2 6icm*?% 0 a 3KsRf 

mmxc*i A#mttmfi ^x^i»©**©-«*^-r suBSB-ctt, amm 221% * * ^$4%*^ bfe 

[0 0 3 9] AttirfBRflrS/X^AB, mU<DV>X<D 3 6 0SOjSHKiO^ffi*»»T5 C fctfTtS. 

^BfiMl^SIl 1 0 t, 9m&® (0>J*tf, Blue »:MM^^-f^ y^LfcO* M 

toot hmomwmm j WML nmzsm fctmspp 1 1 - 1 7 4 6 0 3*4^SKSB^snTv^5 

T^-fiH#}i^«H 1 0 *>&as^sn*H«ttffi*i& <t 5 ftR*^«©»«**iaii« 2 2 ©]igpfc®tt, 

auTA*«if^*»«fraa«4!Bi»« 1 0 0 t&$A, *<D#ftft<Dimwwa^z2om6mm±*ti* i 7 

TfigS. W 2 4t|pI^T^ft$-&TfeJ;t / \ 

[ 0 0 4 0 ] m 2 « % ^o^fiMiw^ii 10 [ 0 0 4 5 ] h 4 ^^fiB#a^s§ 1 0 ©so©- 

©#ia©H?9*^fH-e*»), K»S©«fig© 9^*16 «*iR*-H-efc*. ^4tc^-r<t^ic, ^{uB««S 

[0041] ^^HfiiaH^ii 1 oft '>^<tt, ^scfct-etr*. 

#ffl©W»%ff3«l»a5 3 0f:, B^S»M1 00^ [0 0 4 6] ^ttHWHBSMfcLTtt, 03^^4 

©3*a*X*"r*fe»OX*ff3 6fcfr6«l)««tl*. Lfc^j^^^ H3 J «»H4-?ffl^T^*3RftiB J « , 23W8 
[0 0 4 2] **»ffitCfeV^T. IHttgi5 3 4fCttB® 50 »OtBB*#ft>ftt»©tWK, 


-5- 


•3, mmt. LTfct, «pBB¥ 1 l-1 7 4 603«i 
18, #I8¥ 6-14121 1 ^§£;?$, 4-105 

WciStfifflttBROBfi (AAflfi, B^ffiMS^ 
XKD-I I, Vol. J 7 4-D-I I, No. 1, 
pp. 1 9-2 6, 199 1^1J3), mmuifsvY 

AS. B^BjMS^&MtfcKD- II, Vol. J 7 9 
-D-II, No. 5, pp. 6 9 8-7 0 7, 1 9 9 

6^5£) ssjcaeasnfcto^fetia. 

[o o 4 7] as «, i&mwmmiztizwmgmm. 

[oo4 8] *mE<Dmmmmmm ioo», fc 
ft±»jw» (.umm. &tfc p u^bs&t 3) 1 o 2 

C P U 1 0 2 fc-KX 1 0 4 fc^LTg^StlS, V 

^•©ihmw ^fv^x^-^- f-w 

^-^X+^^r^-r^A^^X^gBl 0 

6, A*T-*©*-*teffl^S«jjMttBl 0 8, &ft 

Bl 1 0, *5£tf, «r*/«88, LA NAT 

S^fA^^-St^TW^D S U«ftt&Jft«9fl 
#-h 1 1 23&»6««*n*. Sfe, AZlSBl 0 6, 
£*&cB 1 0 8fc<fctfffi^»B 1 10S, zti^tixm 
W^-7i-X^LTCPU 1 0 2fCg$S£tVT 

[0049] CPU102&, OS (Operatin 
g System) ^©SMjyn^A, &H©#L1I# 

0, a*©H«^ft±tfA#»fl$W^fc^fT-fS 
fti6<OflHIBira*fT-5 o IBHSBl 2 0«, RAM, R 
OMSO^t'JSii, /N-Kr-fX^OKf-fX^ 
SB, 7W^f^^> ^X^fOXH/- 

S«^lRll|cail!8» 1 2 2*tt«rrs. A738B 1 0 6 

*-,K-F^, ^-^X^^^A/e^S, BSS 

»bi o8«, samara*, ffiasm^srs^t 
mmi 1 ott, tt9tt*M^©Btt£tttfj?sBgft 

SU WAtfyUV^StBWTf**. 3«I#-M 1 2 


(6) 2 0 0 2 - 1 5 0 2 7 3 

10 

7*-*«3MW-*«i**^*. Sfc. BBXtilSBl 
oo a, iao;^yf;i/3yifa-^, 7-*x-f- 
i/ 3 >$fc(i P D A^©1*$8®lilgtc7'j y*^r-r 
X7W***-^X**:TO©B3Bi«*S«U £ 
1f^!!ia»Bfc*^cDA#llff(!S«f^ffi**S$^5 

[oo5o]^(c ccD£5icmm-$ntc*mm<Dj&M 

[0 0 5 1] *«W©Ai«6ff»«T5/X-fAtt, 

«?, ^omrmanm* a*©** **»»©«!»£ 

ft, pJ»IBH^>&^A^A^-r;V?rfflv^ilttCcfc 

A*o»ffo«m*j:o«sfrs. -r*^^, a 

ft©^r;l^LTM, Be, ¥Jfe*<a«LT^Sfc^3«l 
^fefl=***-rsi:» £Hfr6B«i:LT3SBr*ttH 

T°&Zt>\ cnttBB*Tfc#ft©#ftBH)WE£Sft 
20 £H®4Hc#LT#©<£B£j£f5B^lMT3 

[0 0 5 2] 0 6 «, £B©±fc££flttilK-trV9-*B 
BU #££?©»* %fcBLfc*^©£#ffiB«©- 

[0 0 5 3] H6fcwr«|fcJ:tltf» WcBO^'MPtf 
S^t^^c coi^i:, BB*OA*oH*Wfc*W 

[0 0 5 4] B6fcS-rB«ttHS!lfrfff, fl& 

©#ft®H£«5£?-SC£tfWtgfc;&?>, gfc, tfl*. 

£Mra«4>©A{*©IEffi£fctt#ffi©BBfcoi/> 
TtBOfipffiffiB^^-rscfctJ:?), ^©^ffiKB 

y ?*BMaW*©fBl©ffiBfc«BLfc*£fc: t> ^Ttt 
40 S5„ 

[o o 5 5] 07 », mm<D\yyxcom^±yjiiLmn-t 
jB#©— ®j 0 t?& o 

[0 0 5 6] 0 7fc^-TWcJ;n«, £Mt#!*-fe^ 
©*lfil*W»-rs«ii:-e, #KB©+*»^tA©ffi*' 

H©fe6W»fc«ttr©«ft:»c#ft-rs»#*a 

«f SC fctfRTtETfcS. c©iii#K*5^T«©lg«fi 
B*»Wr*c fcT?«aD5nftl*j:tfSllt»lftK:a6*ft» 
*BWr*ci:sWSBfcnrBi:a:*. f*t>5, 0©^ 
50 *^t«W©4W*aWWELTV^Sfc«>, «©Hi© 


n 

[o o 5 7] mste, mmD\s>x<D&*ic£xiiaat 

[0 0 5 8] H8fcnW«fcJ:ntf, ttfcH©fiS»lc 

IBS&lfjfc J:S«BWlft©«rf**lRl«ffcai» , rs £ ttf 
[0 0 5 9] ±SKLfcJ:5fc, mUttUClfcoT^SAfls 

[0 0 6 0] Sfc, SKMfttflOfti&OlSBKiilkAMtf 
5= 

[0 0 6 1] ttfcSHBSftSS'fU^JI^Offi 

[ 0 0 6 2 ] m 9 tt, *¥%m<D% 1 jaBB»#»B*tt 
SAHKff^^X^Atefe^^SSMftaj^O-W* 

i)-©**«E3g:W(cSLTV>So ££T\ H9fcfcV>TSi 
if§§Xf7 ^tt, 0 5 LfcBttg&SH 1 0 
0©/v-F*x7*WtHI*©l 0 2fc*5l,>T*fT**i* 

[0063] cct\ mm&vismtLT, ®mi. 

^flrtr:/* fc»LTgBo©4HKcfc* l e d%J&£ 
EDfii fcJRI©<M©*ttS*tt*ci:-e« 
fiB(C$5 L E D J: ? «§SST'li4 < , P 

nrv^*««o«ft*Jt«LTt±t\ set, tle 

D*M-&T J E-©^iRl*Sacf:*«lt)jg'rj fcv^ci: 
[0 0 6 4] ttTfc, *+U^U-S/ay*IMfK:ff5 

ffPffiB WlRl) ffffi»I0LED*«^f5 

2 . :x— 9*8 L E DOSftfcjlS 

3. H«t»omi©fi'&ffi«*»m , rs 

[0 0 6 5] *+y^U-S/ay*tf3ttfcli. MB© 
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[0066] £f\ ■fey^oiaKuwntrtu a^sas 

SB 1 0 Ofr&fe&fflMMESMf* (Xx-y7S 9 0 
2) „ 

[0 0 6 7] O^T% 1 2 0t«ttS*lfe««eiSllWl 
BHK1 2 2**WHfrr« (X:r>y7S 9 0 4) „ TO* 
#lR]»tiH»l 2 2 J fctt. *I»fc&S«f»&B« 

a83"e&**»© r^a^j ©H©fflii*«£LT*i* 

[0 0 6 8] WP, AfVji i fcOTfSJJIMtr* (X 
70 fy^S 9 0 6) o 

[0 0 6 9] 0(,->T\ 5-vy7l>-i/a><Drc)t><Dtim 
j&DffiaHSNi:, i t&ttJIlrt* (Xx>y7s 9 1 

0) o 

[0070] lit) N^t^i^ta, q«&a£** 

U ■fey9-©S«#tt j e©73lS]^1.5 (Xf7yS9 1 
6) o 

[0 0 7 1] OV>-e, +f U71/— >H><0fti6OII 
(Xf77S9 1 8) , coiIitt*Sfc:ili*E& 

20 [0 0 7 2] M#LfcBiLhT*©lPS (HB) 

ffi«fc#^^2flRl©*ttStttt*fT3 (XT77S9 

20). fllAtf. ®»!S«©-fey9-©«^fc«v li#© 

#ft-ra$EHtiB^±T'fe5@a^snsrc46x wjs 

WW ©ffi*Sft*E5 ci:^#5 0 
[0 0 7 3]O^T?\ i^y^'^vM (Xf'yy 
S 9 2 4) „ Xf-^S 9 1 OfCiRSo 
[0 0 7 4] £fc. ^TOWfcO^TXfy/S 9 
1 67!iSXT'y7°S 9 2 4 ^©fflS&fT? fc* 

^i/-y a >fc«t ^ t» e. tifc ihr&s k awHi * fc 

[0 0 7 5] £f\ 3>T©#^tO^T. Xf7/S 
9 2 0©«jS#^©^t^oTSIS^rR]»miSiC©M 
•f*tr5 (Xr>y7S 9 11). 

[0 0 7 6] OVT, #J*.&\ #3 0 F r ameSh * 
*7T««»fcBflt£Btf#Lfctf 5 (Xr-y/S 9 1 
2) , ffl)»^|fljWHllH»K:S^^TS«^l«a©ttffi*fT 
5 (Xir-y^S 9 14). ft*, *75-f WSIHttai 

40 [0 0 7 7] (^2 gEfifflftg) ARSf)#»#r>Xx Att 

m i ^ssm/oa ? immmm®. mm. b i u e 

toot hVOMffiMlKMimL AN«*dtt) 
T£MtB«lI58Bl Ofr533tffl3ft*iMM*ffi*H 

{ffflsa^i ootcfc^TBiiffiaLTAfrii^^tf 

[0 0 7 8] m 1 0t4. 4^©£2£fflE*K:ttSA 
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[0 0 7 9] &*5s ^Stt-feytf 03^04 

[0 0 8 0] (flfi<D3*fflfi©JBJB) ±»LfcJI»WB»c 

ft Lfc#» #5S«3B C OiS^fcKSS tl* t ©-<?{*& 

<, flS©Sa*©fl5*fc*5^Ttt. 

-&fc>-£TSS£f « c #T sr * c 4: tt 3H#i;: toTl 

[00 8 1] JJSLftjatOJgttfciBV^Tfci:, &3VM 

wms»w 1 o fcwt mmmw 1 o o fc£»37:©ffifti: 

Lrmtt S*£fcHMfcBiflB Lfetf* #«93tt C ©*§ 

^tisssft* «>©■?»&<, ttoj&Ko&flucs^T 
*ffl-r « c t #t? * « c t irgmsic t-^xm^h 
[0082] &L±m^mmAmc %>m% o&mmn 

T?*So LfrL&tf?., ?©SBtf#ffFif3f<©$SHfcfH 

[0 0 8 3] *5fcSfe, *«WOfl&<D^ii0^18fe:45 
VT, JJfiLfcyn^ASttfcptl'VCPUl 0 
fciOSfcfrSftSffiStt, (#!lx.«\ 7a>ytf 

- (iUn T^X^, CD-ROM, DVD-RO 

2;l/-r-#Xhy-A, fc^n^AOJKi 

- FT £ £ i: fc £ ffl* ©Stiftfc&gfc i: fv^T 

fcOTftSROM, CD-ROMr-fX*, DVD-R 

*- a. (b) 35/Ua-*Tfffi«pr«a»#ii*w« 

fcK*»ft: (0fl*.fcf» RAM. 7n«ytf- (SSSS) 

•^T^^nTi/^isso^*-^ (c) mtf7*s? 

# X 1- y - A g fe ttafflSiftfc** Btifc =1 > tf 

a _ £ x-^fl^o cr i: < , ^hmommmmmm 


(8) <®m 2 0 0 2 - 1 5 0 2 7 3 

3 y ^ a - 9 -?wm x> mm a mm l 

[0 0 8 4] 

tiff. ^ttBMM&ffl^SO'Cs SSfcAfHftttOJSflr 
[0 0 8 5] *^{cj;tl«\ Att©-gPfciH£ 

as/Xf-AB, ffilitf, ¥OirfWkW©IRH:, A*©A 
*S*Bifli©pI»#6k iMMBHSfc^AJSAtttr;!' 

ifilSlfcAFfll^^tfiT^STalBlOBW 1 ^©-fey 
[0 0 8 6] ££4C, *»WCJ:ntfx SJBfc«BWlft 
im 1 ] #fSUB©SI 1 Hfl0g«k:«SAf*»fMWfS/X 

50 rAofli^o-wiifew-rBi-ea&s. 

[0 2 ] immntt\m®mmw 1 o ©«^©-^j 

[@3] &smmMS&sm.\ o ©-fi»j*^fHT?a& 

[0 4] ^(£[Hft«KSBl 0©giJ©-ffll*w-rHT? 

Wo 

[0 5] *SIW*<J^«n5B»«B^itlll 0 0(DM 

©-p^-rsT&So 

[0 6] feH©±fc^ffiSft-by9-«»«U, WCt 
40 K©»£*«fflLfc*£©££ttH»©-0!l£^fia-? 

[07] mm<Duyxco?mc±yj{mn^y^^ 

U Wlc»«©»#**fflbfe«^©^ffiiB«©H5y 

[08] aa«©^>x©fe«K^ffi*uit-fe>u-*»« 
u WKta©iss©»t*ttmbfc»^©^ffiH« 

[09] *«W©S 1 ^Sfi»Ji*«ffl«nSAIH»ff» 

Wi/xf- a ic fett 5 isiatftmaraio-ey^-r 7 o -0 

50 T&So 


Vm 2 0 0 2 - 1 5 0 2 7 3 


15 

1 o ^ewta^ss 

2 0 ££ffiB«il?gi$ 
2 2 flffi^ 

2 4 

26 « 

3 0 fHflffi 

3 2 ^SfigP 

3 4 fiBUgP 


1 00 

1 0 2 

1 0 4 

1 0 6 

1 08 

1 1 0 

1 1 2 

1 2 0 


wrnm&m 

CPU 

mmm. 


10 12 2 3Uft#fi*ttiH& 


[01] 



(10) 


#H 2002-150273 



[17] 




(11) 


ttll 2002-150273 


[09] [010] 



(51) int. ci. 7 mmm 

H 0 4 N 7/18 


H 0 4 N 7/18 


(72)%W# 981 

*ja«5=P«BaE*ffl«r-TSii#i^ * 
mmwm m mm 


(72) EJR * 

*B&frJfU£S1$EBKBT 9 AX Ht 5 # 
J&17- 4 -066 
F#-A(##) 5B047 AB02 BA03 BB04 BC05 BC09 
BC20 BC23 CA01 CB22 DC09 
5B057 BA02 BAH CHOI CH11 CH20 

DA08 DC05 
5C022 AAOO AB68 AC51 
5C054 AA05 CA04 CC03 CE02 DA07 
EA05 FD02 GA01 GA02 6A04 
GB15 HAOO 
5L096 CA02 FA66 FA67 FA69 JA11 


